Learning a Motor Grammar of Iconic Gestures
نویسندگان
چکیده
In this paper, we present a computational investigation into the compositionality of iconic gestures by trying to learn a motor grammar. We propose a grammar formalism that learns (1) the salient, invariant features of single movement segments (motor primitives) and (2) the hierarchical organization of these segments in complex gesturing. The formalism is applied to a dataset of natural iconic gestures. The extracted structure reveals compositional patterns of iconic gesturing.
منابع مشابه
A Hybrid Grammar-Based Approach for Learning and Recognizing Natural Hand Gestures
In this paper, we present a hybrid grammar formalism designed to learn structured models of natural iconic gesture performances that allow for compressed representation and robust recognition. We analyze a dataset of iconic gestures and show how the proposed Featurebased Stochastic Context-Free Grammar (FSCFG) can generalize over both structural and feature-based variations among different gest...
متن کاملThe impact of iconic gestures on foreign language word learning and its neural substrate.
Vocabulary acquisition represents a major challenge in foreign language learning. Research has demonstrated that gestures accompanying speech have an impact on memory for verbal information in the speakers' mother tongue and, as recently shown, also in foreign language learning. However, the neural basis of this effect remains unclear. In a within-subjects design, we compared learning of novel ...
متن کاملA micro-analytic investigation of how iconic gestures and speech represent core semantic features in talk
This study investigates the communicational role that iconic hand gestures (see McNeill 1985) play in everyday talk. When we talk about iconic gestures, we are referring to very special sorts of hand movements, which most people produce unconsciously, and which seem to convey meaning associated with the content of spontaneous speech. Iconic gestures must be distinguished from all other types of...
متن کاملBeat gestures facilitate speech production
Does gesturing help speakers find the right words? According to several theories of speech-gesture relationships, iconic gestures should facilitate speech production, but beat gestures should not. Here we tested the effects of gesturing on word production in two experiments. Participants produced lowfrequency words from their definitions while instructed to perform beat gestures, iconic gesture...
متن کاملGesturing Meaning: Non-action Words Activate the Motor System
Across cultures, speakers produce iconic gestures, which add - through the movement of the speakers' hands - a pictorial dimension to the speakers' message. These gestures capture not only the motor content but also the visuospatial content of the message. Here, we provide first evidence for a direct link between the representation of perceptual information and the motor system that can account...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2014